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ABSTRACT 

Employing multiple case study analysis methods, the 
attitudes and actions of superintendents in three school districts 
With improving basic skills test performance were compared with those 
of superintendents of three nonimproving districts to determine if 
patterns of difference existed. Contextual variations and 
superintendents' priorities were explored as antecedents to actions 
and outcomes. Four contextual varieibles were identified as 
potentially relevant to superintendent behavior, including 
superintendent and principal tenure, community climate, grade 
configuration and dispersion of attendance centers, and district 
financial condition. Superintendent's actions were classified under 
the nine control functions identified by Murphy and associates; 
supervision, selection, socialization, evaluation, rewards and 
sanctions, goals, resource allocation, monitoring, and behavior 
control. In improving districts, there was greater principal 
awareness of superintendents' goals and priorities; greater evidence 
Of shared superintendent-principal control; a higher priority for 
teacher evaluation and/or supervision; and more attention paid to 
analyzing test results, caution is needed in adopting a single set of 
practices at the district level to improve student outcomes. 
Comparisons of test and nontest indicators of student outcomes in the 
six districts illustrated the complexity ana ambiguity of classifying 
districts as improving or nonimproving on the basis of multiple 
outcome or single indicators. (35 references) (Author/MLH) 
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THE SUPERINTENDENT AND SCHOOL IMPROVEMENT: 
ANTECEOB^ ACTIONS AND OUTCOMES 



Roberta Moehlrnan Jackson 

George J. Crawford 
The Ui.iversity of Kansas 

Lawrence, Kansas 

For the past two decades much educational research has locused on studies classified under the 
headings of 'teacher effectiveness" and "school effectiveness" (Brookover, Beady Flood 

* Wisenbaker, 1979; Edmonds, 1979; Rosenthal & Jacobson. 1968; Staliings 
1985). This research has examined teacher and principal behavfors and classroom and school 
characteristics associated with exceptional student perfonnance. Although some have criticized 
effectiveness research for the narrowness of its dependent variable (standardized test scores) 
overgeneralteation to contexts beyond its focus and lack of theoretk;al foundatfon (Cuban. 1984 
Hoy & Miskel. 1987; Purkey & Smith. 1983). it has been wkfely accepted by practicing 
educators and poifoymakers as a model for Improving schools and teaching. Numerous school 
systems and many states have implemented programs designed to Incorporate effectiveness 
correlates at the classroom and school level (Cuban, 1984; Purt<ey & Smith. 1985). There is 
little mention, however, of the central offtee and the role of the superintendent In the 
effectiveness literature. The research has focused on the school or classroom as the unit of 
analysis, with emphasis on the behavtor teachers and principals. Despite recent calls for 
decentrallzatton of authority, schools remain part of a larger school distrfot organizatton It 
seems likely that the policies and practices of the larger system, partfoulariy the actions of the 
superintendent, have an effect on what goes on In schools and ultimately on student outcomes 
Recent studies and self-reports by practicing superintendents have begun to address this issue 
by Identifying superintendent actfons In effective and Improving districts (Aplin 1984- 
^oo^'"^" 5 'l^i?'*' J®.?®= DeYoung. 1986; Hallinger & Murphy. 1982; Hill. Wise. & Shapiro 
lllV * Mendez-Morse. 1990; Jacobson. 1986; Murphy, Hallinger. & Peterson. 

1985; Murphy, Peterson, & Hallinger. 19C6; Murphy. Hallinger, Peterson. & Lotto, 1987- 

vZVmTZia^^^^^^^ ''''''''' * ^P'"-^' 

Literature Review 

A review of the devetoping Kterature on distrkrt level effectiveness and the role of the 
superiritendent in school improvement revealed potential distrtet level effectiveness correlates 
The following were most frequently reported in extant literature as characteristic of effective ' 
and/or improving districts: 

1) Formal district goals with an emphasis on student learning 

Although descriptions of the process of goal dovetopment vary, the literature 
*^°rK?ri'LI!P^S? o'^ect've districts and districts Involved in improvement initiatives 
establish district wkto goals endorsed by the board of educatfon and that the content of goals tends 
1^ ^" Improvement of student achievement and^or curriculum and instruction (Aplin 
1^&84; Brown & Hunter. 1986; Cuban. 1984; DeYoung. 1986; Hallinger & Murphy 1982; 
w n ""986; Peterson et al.. 1987; Spiliane. 1984; Vtekery. 1988; 

W8liaCG| 1985)* 
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2) Extensive staff dsvslopmsnt programs with smpttasls on principals' 
supervisory skills and toachsrs* Instructional skills 

Eleven of the 12 superintendents included in a study of effective Califbmla districts 
reported they had system wide staff development programs for teachers and personally 
controlled the content of approximately 40% of the programs. The focus of these programs was 
on the establishment of particular teaching models and Implementation of district curriculum 
(Peterson et al., 1987). Other reports also speal( of an emphasis on staff development, 
aithough with somewhat greater subordinate control over content (Vickery, 1988; Wallace, 
1 9^3K 

3) Formal and systematic staff evaluation systems with criteria tied to the 
accomplishment of district goals 

The literature reports superintendents In effecth^e distrtets and districts engaged In 
school Improvement frequently revise evaluatton instruments to align criteria with district 
goals and instructional models (Cuban, 1984; Murphy et al.. 1987; Wallace. 1985). In 
addition. Murphy et al. and Wallace describe highly systematized evaluation procedures with an 
emphasis on accountability lor results (primarily student performance on standardized tests) 
as a component of both teacher and principal evaluation. 

4) Replacement of ineffective principals and teachers 

Cuban (1984) points out that superintendents' emphasis on test scores, holding 
principals accountable (or district goals, and the reviston of evaluation Instruments to reflect 
these changes can ■ raise the spectre that principals' jobs are on the line if they don't produce" 
(p.149). This contentton is supported by the literature whteh reports that superintendents of 
effectivo distrtets and those engaged in improvement Initiatives take action to terminate 
Ineffective principals and teachers (Jacobson, 1986; McCrudy, 1983; Murphy et al., 1987). 

5) Standardized district curriculum and superintendents' persona^ involvement 
in curriculum and Instruction. 

The literature portrays the "effective distrtet" superintendent as highly involved in 
curriculum and instruction with central control over curriculum (Aplin. 1984- De Young 
1986; Haliinger & Murphy. 1982; Murphy et al., 1986, 1987; Murphy & 
Hailinger, 1986, 1988; Peterson et al., 1987; Spillane, 1984; Vfckery, 1988; Wallace. 
1985). This centralized control of curriculum frequently Involves the alignment of 
curriculum objectives with standardized test content (Hailinger & Murphy. 1982; Spillane 
1984; Vtekery, 1988; Wallace. 1985). Some reports describe adoption of centralized 
Instructtonal models as well (Murphy & Hailinger, 1986; Wallace. 1985), while others 
indfcate specific instructtonal models were not dtetated (Spillane, 1984; Vickery, 1988). 

6) Formal systems for monitoring progress on district goals and student 
outcomes 

Cuban (1984) states one of the things that may be characteristte of superintendents In 
improving distrtets is the active monitoring and assessing of the instmcttonal program. Recent 
studies tend to support Cuban's assertten. The study of the 12 effective California distrtets 
found superintendents of these districts actively monitored technical core activities through 
school visits, meetings with principals, collection of school work products and inspectton of 
standardized test results (Murphy & Hailinger, 1986; Murphy et al..1985). Other authors 
wnting about superintendent acttons associated with school improvement also describe 



elaborate systems for monltorino student performance outcomes and progress toward ooal 
accomplishment (Aplln & Daresh. 1984; Hill et a!., 1989; Wallace; 1985). 

7) Superintendent acquisition of fund* for •ducatlonal improvement and 
centralized budget control. 

Uterature describing superintendents' actions In improving and effective districts 
reports three general categories of behavior associated with resource acquisition and allocatjon: 
(a) the acquisition of funds from business (Hill et ai., 1989; Splllane. 1984), (b) the 
superintendent's ability to obtain support for tax increases tor educational Improvements 
(DeYoung 1986; Jaoobson. 1986), and (c) centralized, as opposed to building level budget 
control (Hord et al.. 1990; Murphy et ai.. 1987). 

AltlTough these seven elements emerge as possible behaviors and district characteristics 
related to improvement and effectiveness, only one of the cited studies (Jacobson, 1986 1988) 
compared superintendents' behaviors In an effective and ineffective school district. The relative 
ateence of studies which compare Improving and nonimproving districts malces it impossible to 
determ ne whether these district characteristics and superintendent behaviors are untaue to 
Improving and effective districts. ^ 

Purpose of the Study 

.Ko . °'it!*® *° ^ *° ^'^'^""O knowledge base concerning the role of 

the superintendent in school improvement and effec Jveness. The study Investigated the actions 
and attitudes of superintendents in districts which, over a five-year period, had experienced 
Improved basic sidlto test performance, comparing their actions and attitudes with those of 
superintendents in districts which had not shown improvement. The purpose of this comparison 
was to search for differences In the behavior patterns of superintendents of Improving and 
nonimproving districts. k w v. 

As a secondary focus, the Investigation examined principals' perceptions of 
superintendents' attitudes and actions and the effects of these actions on principals' behavior 

I^'lfit^J^^J fJ*"**^. ^T^. ^ °' ^^^''y'"*' superintendents' reports of their actions. 
Lu. as Indicattons of principals' percep'iions of the effects of district level actions. In 
addition, district contextual features were examined as possible antecedents to superintendent 
fS?^ f*"**®? outoomes were collected as a means of exptoring the relationship 

among multiple indicators of effectiveness and possible llnltages between superintendents' 
attitudes and actions and student outcomes. k .o 

Conceptual Framework 

The conceptual framework for the study foltows Bridges' (1982) reoommend^itton that 
studies of educational administratton sho' ld include simultaneous examinatfon of the three 
components of Halpin's (1966) model for research on administrative behavtor: (a) 
antecedents, (b) behavior, and (c) outcomes attributable to behavtor. District contextual 
bBhavkiT attitudes were examined as potential antecedents to superintondent 

Murphy et al., (1987) provide a framework of nine control functions for examining 
J15!!!ln!Tf!r!i; '"^^"'ctf'ra' iaadership behavtors and control of principais' actions. These 
functtons irtoiude supervision, selection, socializatton, goals, evaluation, rewards and sanctions 
resource aliocatton. behavtor control/monitoring, and lechnteal core (curriculum and 
. ^?i2l3 '"'"^^ modificattons based < n recent studtos (Hill et al., 1989; Hord 

et al.,1990; Jacobson. 1986), Murphy et al.'s. nine control functions were cmptoyed as bases 
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for oroanizlng data related to superintendent behavior and comparing the actions of 
superintendents in the current study with extant literature. 



Under the outcome component of the model, district performance improvement on a state 
required criterion-referenced reading and mathematics test was employed as the means of 
Classifying a district as improving or nonimproving; however, other student outcome indicators 
Including attendance rates, dropout rates, and postseoondary attendance patterns were also 
examined to explore the relationship aiTK>ng multiple indicators of effectiveness and to search 
for possible connections among superintendents' attitudes, actions and outcomes. 

Study Methods 

. ..^^^.'""ll'Pi^.^^se study design was employed. Following a practice utilized by Murphy et 
a . ( 987) and Glickman and Pajalt (1986), a point system was doveioped to specif the degree 
of district performance Improvement on the Kansas Minimum Competency Test, a criterion- 
referenced test of reading and mathematics. All Kansas school districts administered this test 
each year frorn 1985 through 1989 in grades 2. 4. 6. 8, and 10. The point system took Into 
account a district's performance on each of the 10 state tests (reading and mathematics at grades 
z. 4. 6. 8 and 10) in relation to Its own past performance and in relation to that of the state as 
a wnole. 

Only those districts having the same superintendent over the five year period of interest 
and whose performance had been relatively low in relatton to that of the state In 1985 were 
considered for selection. Three districts experiencing the greatest improvement were matched 
on the basis of size, racial/ethnic composltton, and SES with three districts whose test 
performance tjad declined between 1985 and 1989. The six selected districts were relatively 
small, mral districts in which the superintendent was the only district level administrator 
They had student enrollments ranging from approximately 700 to 1900 and had two to five 
attendance centers. All six superintendents were male. 

Data were collected In the spring of 1990. On-site Interviews. Informal observation 
and document examlnatton formed the basis for qualitative aspects of the study Seml- 
slructured. In-depth interviews were conducted with superintendents and two" principals (one 
elementary, one secondary). Each interview was approximately 2 to 2 1/2 hours tong. Other 
key personnel were Interviewed informally relative to Issues which emerged in the process of 
conducting formal interviews with superintendents and principals. Interview data were coded 
for ana5f8ls uslrig the study's conceptual frameworli as an initial schema. An independent iudae 
fl^Jf^ *^!? r;'*' an^itewsote^ agreement rato exceeding 85%. Test data, other outcome 
Jdicator data, and district financial Informatton obtained from the State Department of 
Education formed the basis for descriptive, quantitative analysis of student outcomes and 
contextual variations associated with district wealth. 

Study Findings 

This section reports the findings associated with each of the components of the conceotual 
frameworit: (a) contextual and attltudlnal antecedents, (b) superintendent behavfors and 
district level acttons and (c) student outcomes. 

Contextual AntpcflHAnf^ 

Three categories of district contextual variatfon were Identified as potentially relevant 
precursors to superintendents' behavior: (a) district contextual problem index, (b) grade 
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configuration and location of attendance centers within the district, and (c) superintendent and 
principal tenure. 



Contextual Probiem InriPK 



The degree to which a district is experiencing problems was identified as a potentially 
relevant antecedent affecting superintendents' actions. Problems such as failed bond 
referendums. labor disputes, and lack of community support for schools were contextual 
etements classified under the construct contextual problem Index. Particularly In districts In 
which the superintendent Is the only central office administrator, a high problem Index \lkeW 
has an effect on the superlntendenfs ability to devote attention to the technical core and 
administrative actions associated with instructional leadership. 

A superintendent of one of the Improving districts, for example. spoKe of great animosity 
t>etween teachers and the board of education when he assumed his post as chief administrator 
When asked to identify his personal goals for his district, a possible effect of this contextual 
situation on the superintendent's actions was revealed: 

1 thlni< the first focus was that we get along with folks. We can't have teachers writing 
letters in the paper about the board, and we can't have the board taking out a paid ad In 

the paper to state similar things about the teachers So that and survival were the 

top two things on the list. Following that 1 think we moved Into staff development 
Then we bastoally did student learning and Instruction. 

This and similar comments by other superintendents indicate the perceived need to deal with 
certain contextual problems prior to addressing technical core Improvement Initiatives. 

Problems associated with inadequate facilities were particularly common. All six districts had 
initiated bond referendums for facility improvements within the past five years. Although no 
clear pattern of difference emerged between improving and nonimproving districts 
superintendents frequently spoke of conflict surrounding bond referendum elections and 
reported devoting considerable lime to efforts directed at bond electtons and faciliw 
Improvement. 

Grade Confinuration and AttendannQ Cfln ter Location 

^2? d'slrtets there are frequently too few students to warrant a separate buMdina 
for middle school or juntor high age students. These students are placed in the elementary 
schools under the superviston of elementary principals or In the high school under the 
supervision of the high school principal. Moreover, although student enrollments are 
relatively tow. rural distrlcis are often composed of several smaller independent communities 
each of which has its own school. This results in a disperston of attendance centers. These two 
factors were identified as potentially relevant contextual variattons. 

There was some evkJence that principals were more satisfied with the placement of grade 
L?H .® students in the high school setting than in the elementary setting, in two of the dislrtets 
(both improving), seventh and eighth graders were housed in the high school under the 
supervision of that principal, while In two other districts (one improving, one nonimproving) 
these students were In the elementary schools) under the supen^lsion of elementary 
principals. Elementary principals In this situatk^n complained of a lack of time to devote to 
instructtonal leadership. The comments of one K-8 principal speaking about the need for a 
system lo monitor teacher implementation of the currteulum were typteal of the frustration 
these principals expressed: 



That is one of the goals I have and would like to work on, txJt that comes into the 
-busyness" of a K-B bulMing. One thing 1 find In the K-S structur 9 is such a wMe variety 
of needs of the students, staff and so forth that even though the school Is smaR. you are 
spreading yourself over Just a wkto variety of tasks. If our dlstrtot was stnjctured 
differently it wouM be easier to focus in on curriculum and teacher supen^isfon because 
you'd be supen^lsing maybe nwre teachers, but a narrower band of curriculum and that 
wouki be easier. 

Principals of 7-12 bulUings did not register such complaints, in both 7-12 schools there was 
an assistant buikJing administrator. There were no assistant buikJing administrators in K-8 
buildings. 

This contextual variatton is not viewed as a relevant antecedent to superintended t 
behavtor. However, since ail superintendents expressed the desire that principals focus their 
attentk>n on technteai core issues, it does appear to have a potential effect on the ability of the 
buikiing principal to respond to superintendents' preferences. 

UKjation of attendance centers may have a more direct effect on superintendent behavior, 
in four of the districts the superintendenrs offtee was k>cated on the same site as one or more of 
the schools. In such a context supen/iston and monitoring may take on a different meaning than 
in the distrfct in whteh the superintendent must make a oonsctous. planned effort to visit 
schools for supen^isory purposes. It also may be that where there is frequent informal 
superviston, the superintendent feels less need for planned visits designed to formally monitor 
and supen^ise technkal core processes. In such districts administrators reported that the 
supenntendent was in the school every day and monitored In infonnal ways. One superintendent 
commented: "About every moming 111 slip by and say good morning and helto. That gives me an 
opportunity to obsen/e." The principal of one of the schools whteh was adjacent to the 
superintendent's offfce described the superintendenrs visits in a similar manner. "He's very 
good about coming down and vIsHlng. He'll walk through the buikiing and go In the tounge and 
have a cup of coffee and sit around and visit." Administrators of these small distrtets frequently 
Indicated that monitoring principals' wori< and what goes on in the schools was simply not an 
issue. 

Superintendflnt and Prin ftipal Teniira 

Five Of the six superintendents in the study had 10 or more years' tenure in their 
current distrtets, while one superintendent of an Improving distrtet had only five years' 
experience as a superintendent, ail in his cun-ent distrtet. Four were nearing retirement 
There was some evklence that superintendents eariler In their tenures in a distrtet were more 
actively engaged In currteulum and Instruction and In directing technical core activities. 

Describing a change in the principal evaluatten process In one of the improving 
distrtets, one principal sate: "Of course It has become more difffcuii. WeVe been around a tona 
time, and 1 think for several years he always worited to write on areas we might Improve. 
He's shied away from that In the last three years." Another principal speaking about the process 
of bulteing goal devetepment whteh had at one time been required stated: "I'd say he dte H 
probably tv/o or three . . . years. Of late, the last three years or so. he has sort of dropped that " 
The superintendent confinned this change in his behavtor and provWed a rattenale: "We know 
now what we are trying to do In each of our schools. It was a good task in the beglnnino for them 
(principals) to try to figure out what they wanted to do and how they were going lo do it." 
Another superintendent commented that he had personally chaired the district's curriculum 
devetepment committee "the first year or two so some leaming coukJ take place." 
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Such comments were typical of administrators in four of the five districts in which the 
superintendent had relativeiy long tenure, interestingly, although obviously perhaps only 
oolncidental, the superintendent with only five years' tenure was the most directly Involved In 
technical core activities. This superintendents actions most closely matched those described In 
extant literature. 

The relationship between principal and superintendent tenure also emerged as a 
potentially relevant antecedent to superintendent behavior. Peterson (1987) describes 
selection-socialization as "the primary control that shapes the goal structure of principals" (p 
146). Superintendents may either select principals who share their priorities and goals or 
they may socialize them to shared priorities and goals. The superintendent who has personu"' 
selected all the district's principals Is obviously operating In a very different context than the 
superintendent who has not had the opportunity to select any principals and is in the process of 
trying to replace or reform those he or she has inherited. 

In relation to administrator tenure, two general categories of principals may exist In a 
distrlct-those the superintendent has hired (selected principals) and those who preceded the 
superintendent (inherited principals). Within each category, principals may possess the skills 
and values preferred by the superintendent, or they may have ideas which conflict with those of 
the superintendent. Four possible variations related to superintendent-principal tenure and 
the degree to which principals possess the skills and values desired by the superintendent are 
Illustrated in Figure 1. 



Figuffl t . Matrix of superintendent-principal tenure and skili^aiue match 

Principal Selection Status 



Match 

Superintendent 
Preference 

Principal 

Skill/Value 

Match 

Confltot with 

Superintendent 

Preference 



1 


II 


III 


IV 



The dtehotomous classlfteatton of skills and values as either matching or In conflict with 
hose desired by the superintendent is a likely slmplifk:atk>n. Rattier than being dtehotomous. 
this variable is more likely continuous; however, the model serves to illustrate a potentially 
relevant variable associated with superintendent action. Eariy in her or his tenure a 
superintendent will obvtously have mostly Inherited principals. The superintendent with 
kjnger tenure has had greater opportunity to select and/or socialize principals. It is reasonable 
to expect that superintendents of districts In whteh most principals fall In cell I might fes' less 
need to be personally Involved In technteal core matters than superintendents of distrkns having 
mostly cell IV principals. The superintendent of a distrtot with cell IV principals Is togteally 
directLng his or her energies toward reforming or replacing these principals. 



Thig Study focused oonsiderabia attention on explorino superintendents' attitudes, goals 
and priorities. It was assumed that wtiat a superintendent deems to be Important would be 
reflected In his or her actions and potentially In student outcomes. Superintendent attitudes 
were believed to be an important consideration relative to the emerging image of the 
superintendent as highly involved In technical core initiatives and also relative to the 
classification of districts as effective or ineffective on the basis of test performance, it was 
believed lilcely that the degree of superintendent involvement In curriculum and instructioii 
would be related to his or her attitudes regarding the appropriateness of such involvement, and 
Improvement in standardized test pertbnnance was seen as potentially related to the degree to 
which a superintendent viewed test performance as a valid indicator of student learning and an 
important student outcome. Each superintendent was asi(ed to kJentify his top three personal 
priorities or goals for his district over the past five yea.-s as a means off exploring this issue. 

Technical Com RfttA 

There was considerable evidence to suggest superintendents did not see direct 
Involvement In the technical core as their role. In two Improving districts and iwo 
nonimproving districts superintendents expressed a philosophy of principal and teacher 
autonomy in relation to curriculum and instructionai issues. Furthermore, all four of these 
superintendents expressed a perception of personal inadequacy In the areas of curriculum and 
nstruction, indicating they did not have sufficient time or experfise to serve in an instructional 
leadership capacity. More frequently superintendents in both Improving and nonimproving 
districts expressed the opinion that their role was to provide for a quality staff and/or financial 

improvement. When hsket specifically to identify their personal goals and 
priorities for their districts, five of the six superintendents menttoned the goal of having a high 
quality staff. 

Process Versus QutoomBs 

Other frequently identified goals were classified as technical core process goals- 
provkJIng quality programs and general Improvement of curriculum and Instruction. Such 
priorities were described by five superintendents, but the emphasis was deariy on process 
rather than outcomes. Superintendents talked at length and with pride concerning what they 
perceived to be improvements In cuniculum and programs; however, there was little 
Indication of Interest in empirical assessment of the effects of these improvements on student 
outcomes. This was true in districts with improving test performance as weli as those with 
nonimproving performance. 

Princlpai Pftrnflptinns 

Each Interviewed principal was asked to Wentify what he or she believed to be the 
superintendenrs top three goals or priorities tor the distrtet In the past Hve years. One pattern 
of difference between improving and nonimproving districts emerged In this regard In 
Improvirjg districts there was a greater congruence between superintendents' statements and 
principals percepttons. Table 1 reports the number of correct matches tor each fomiailv 
interviewed principal. 



Table 1 

Number of Correct Idftntifinfltions of StinArintanriftnte' Statad r^ als hv PrinHpflk 



Number of Correct Matches 



District 


Principal 1 


Principal 2 


Total 


* A 


2 


1 


3 


' B 


2 


1 


3 


• 0 


2 


2 


4 


D 


0 


0 


0 


E 


1 


1 


2 


F 


2 


0 


2 



• Improving Districts 



h the three Improving districts (A. B, and C) both formaiiy interviewed principals correctly 
idem ied one or more of the superintendents' goals. In District E. both principals correctly 
Identified only one goal, while in the three Improving districts at least one principal Identified 

^r?nS^^l^i^'l^' P^'^^'P^' IdBnmed two goals while the second 

principal Identified none. Neither of the District D principal respondents correctly identified 
any of the superintendent's goals. 

SuPerlntendflnt Behflvinr ar yj PinMM Arting ^ 

- J!?® study generally did not find the district level policies and superintendent 

actions Iderjtified In the literature as characteristic of Improving and effective districts to be 
the Improving districts than the nonlmproving districts. However, some 
n ^ ^"^^'OB. Clear patterns of difference between actions In Improving and 

^??!r»'^ ""^r® *° ^^^""^^^ selection, staff evaluation, monitoring 

or test results, and organizational control. 

Teacher sftlnfitjgn 

In Improving districts the hiring process was a joint activity between DrindDals and the 
superintendent with relatively equal conta)l and bivolvefnent by both. In one of the 
nonlmproving districts (District E) the process was also shared, but with greater 
superintendent control. Principals In the other two nonlmproving districts apparently had 
primary control over the teacher hiring process (D and F). Table 2 Illustrates these 
aiiTsrsncos* 



^1 



Table 2 




improving Districts 



Nonimproving Districts 



Actions 



A 



B 



C 



D 



E 



F 



Both supt. & principal 
screen, interview, & 



X 



X 



X 



select 

Supt. screens and 
controls final selection, 
joint principal supt. 
interviewing 

Principal control of 
hiring process 



In relation to the selection function, the findings of the current study are generally 
supportive of the findings of Murphy and Hallinger (1986). They report the superintendents 
in their study of effective California districts "maintained a balance of "dynamic tension' 
between district control and local autonomy in the selection of new staff" (p. 222). in the 
current study this seemed more true of superintendents of Improving districts than 
nonimproving districts. 

Staff Evaliifltinn 

Under this control function, teacher and principal evaluation practices were examined 
The study provided evidence of more frequent observation and evaluation of teachers in 
Improving districts, and both superintendents and principals in these three districts indicated 
greater emphasis on evaluation of teachers than was present in the nonimproving districts. 
There was no pattern of difference related to principal evaluation. Principals In all districts 
except D reported they were evaluated annually by the superintendent. Table 3 illustrates 
findings related to teacher and principal e aluation. 
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Table 3 

Actions Assonialed with Tflacher and Prinr lpal Evflinfltion 



Actions 



District requires more 
frequent teacher 
observation and 
evaluation than required 
by law 

Principal (one per dist.) 
identifies teacher 
evaluation as time- 
consuming task 

Supt. identifies teacher 
evaluation as a priority 
for principals 

Principals & supt. 
report principals 
evaluated by supt. 
annually 



Improving Districts 
ABC 

X X :: 

XXX 

XXX 
XXX 



Nonimprovlng Districts 



D E F 



X 



There was no indication in the current study that districts, improving or nonimproving. 
had revised evaluation instruments to align criteria with district goals, and instructional 
models as the literature suggests is prevalent In effective and improving districts (Cuban 
1984; Murphy et al., 1987; Wallace. 1985) or that accountability for results, as loentified by 
Murphy et al. and Wallace, was a component of teacher or principal evaluation. 

Monitoring Tast Rftsiiit?^ 

In relation to the monitoring of test results there were some observable differences 
between improving and nonimproving districts; however, no district, Inproving or 
nonimproving, described the kind of systematk; monitoring of test results described In the 
literature (Aplln & Daresh, 1984; Haliinger & Murphy, 1986; Hill et al., 1989; Murphy et 
al.. 1985; Wallace, 1985). Table 4 illustrates acttons associated with monitorlna test 
results. ** 
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Table 4 

Actions Associated with Mnnitorinn Rtfli.riflrHiyflH Tft«^f p erformanca 



Improving Districts Nonlmproving Districts 



Actions A B 



Principal and/or 

counselor analyze and X X 

report test iesults to 

board 

Superintendent analyzes 

and reports iest results X 
to board 

Elementary principal 

analyzes/examines XXX 

results across years by 

classroom 

Elementary principal 

talks to teachers about XXX 
test results 

Administrator concern X 
over test results 

District goal related to X 
test performance 

Single individual 

responsible for curr. XXX 
dev. and test results 



In Districts A. B and C. the districts with Improving State test results, elementary principal*^ 
provided evidence that they monitored results across years and by classroom: however, It Is not 
clear to what extent this action was at the initiative of the supeiintendents. Moreover In 
improving districts the same individual was responsible for both curriculum development and 
analysis of test results. This was not the case in nonlmproving districts. It may be that the dual 
responsibility for curriculum development and test analysis results in some attention to 
curriculum-test alignment. 



"t4 



The literature reports some evidence of tighter coupling between central office and 
schools In effective districts and districts engaged in Improvement Initiatives (Murphy et ai., 
1986: Splllane. 1984; Wallace, 1986). In the current study only District C wn'b«®p^ , 
Indications of tighter coupling between the schools and central office of the type described in the 
literature. In other districts the connections between central office and the school appeared to 
be relatively loose. 

Indications of top-down and bottom-up control were also examined. In this regard an 
interesting difference between Improving and nonlnriprovlng districts was observed. There was 
greater evidence of shared superintendent-principal control In the Improving districts. Two 
nonlmproving districts exhibited a greater tendency toward bottom-up control while one was 
more top-down. Table 5 Illustrates the presence of top-down, bottom-up, or combined control 
in relation to various administrative functions. 

Tables 

FvidAnfift of Tnp-nown and Rftttnm-lJp Co n trnl in Administrative Areas Rfllfltftd tQ TflChnlca l Corfl 





improving 


Districts 




Nonimproving 


Districts 




Administrative Areas 


A 


Q 

D 


p 


w 




F 


Curricuium 


T/B 


B 


T 


B 


T/B 


T/B 


Instructional Specification 


B 


B 


T/B 


B 


B 


B 


Staff Oevelopment 














Teachers 


T/B 


T/B 


T/B 


B 


T/B 


B 


Principals 


T/B 


T/B 


T 


B 


T 


B 


Teacher Selection 


T/B 


T/B 


T/B 


B 


T 


B 


Student Rewards/Sanctions 


B 


B 


T/B 


B 


B 


B 


Budget Allocation 
















T 


T/B 


T 


B 


T 


T/B 


Total Top-Down 


1 


0 


3 


0 


3 


0 


Total Top-Down/ 


4 


4 


4 


0 


2 


Z 


Bc^tom-up 














Total Bottom-up 


2 


3 


0 


7 


2 


5 



' T - Top-down, superintendent actions dominate 
6 " Bottom-up, principal autonomous actions dominate 
T/B ■ Combined top-down and bottom-up actions 
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'^he table reveals there is more evidence of combined top^wn/bottom up control in the 
improving districts. The type of top-down/bottom-up control evident in the improving 
districts in the current study, however, was not the variety typically described in the 
literature. For example, Cuban (1984) describes the combination top-down/bottom-up 
strategy as involving mandates from central office for the establishment of goals and procedures 
for assessing outcomes, but school control over processes. Similarly, Glickman and Pa\ak 
(1986) describe the top-down/bottom-up district in their study as having centrally 
established goals, but school latitude in establishing objectives and ptocesses for meeting the 
goals. The type of top-down/bottom up control found to be prevelant '.n the improving districts 
in the current study might be more accurately described as balanced or shared. In the 
improving districts, principals were not as totally autonomous as they apparently were in 
Districts 0 and F; yet. there was little evidence of top-down control, particularly in Districts A 
and B. Superintendents had tal<f>n actions to socialize principals to their priorities, but there 
was little indication they forced the issue If principals failed t? comply with their priorities for 
them. As previously reported, there was also greater principal awareness of superintendents' 
priorities and goals in these districts which may be related to the greater tendency for shared 
decision-making. In many respects the actions of Superintendent E are similar to the actions of 
superintendents of improving districts in this regard, but greater top-down control was evident 
in District E. 

Student Outcomes 

The use of test performance as the sole criterion of effectiveness or improvement has 
frequdntly been criticized in relation to the effective schools research (Bossert. 1988; Cuban, 
1984; Fechtling, 1989; Purkey & Smith, 1983; Rowan. 1985; Rcwan, Bossert, & Dwyer. 
1983). In the current study, like most studies of school effectiveness, test performance was 
used as the criterion for classifying a district as improving or nonimproving. Districts A, B and 
C were classified as improving districts on the basis of their State Minimum Competency Test 
pass rates in 1985 and 1989, while Distrk;ts D. E and F were classified as nonimproving. On 
this outcome there was a clear distinction between improving and nonimproving distrtets. 
However, when other student outcome indicators were examined the distinction became less 
clear. 

Other Outcome Data 

Table 6 presents other student outcome indicator data which were consistently available 
for all six districts from the State Department of Education. Indicators include district 
attendance rate, dropout rate, percent of students attending college, and percent attending all 
postsecondary institutions which includes vocational training as well as two and four-year 
college attendance. 
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Tables 

State and District Student Outcome indirMM Data far iq«s anrf ^<|ftQ 



• Attendance * Dropout • College * Postsecondary 
^0 Rate Attendance Attendance 



Uistrict 


1985 


Gain/ 
1989 Loss 


1985 


1989 


Gain/ 
Loss 


1985 


Gain/ 
1989 Loss 


1985 


Gain/ 
1989 Loss 


* * A 


96.3 


95.6 


- .7 


1.3 


1.8 


.5 


33.3 


58.0 


24.7 


36.8 


61.3 24.5 




94.4 


95.5 


1.1 


3.1 


3.0 


- .1 


32.2 


54.2 


22.0 


35.7 


54.2 18.5 


••c 


95.8 


94.9 


- .9 


1.4 


1.0 


- .4 


60.7 


68.3 


7.6 


74.5 


70.7 -3.8 


D 


94.9 


95.1 


.2 


3.1 


3.4 


.3 


60.0 


70.8 


10.8 


63.2 


78.2 13.0 


E 


95.8 


96.9 


1.1 


2.4 


2.0 


- .4 


55.5 


55.2 


- .3 


65.1 


62.1 -3.0 


F 


95.7 


95.3 


-.4 


3.2 


3.6 


.4 


42.9 


52.1 


9.2 


54.5 


54.5 0- 


State 
Average 


NA 


94.5 


NA 


4.0 


4.5 


.5 


57.0 


64.0 


7.0 


65.3 


70.1 4.8 



* All data expressed In percentages 

• * Improving districts 
NA Not available 



Average daily attendance rates for the six districts are similar and In all cases slightly 
higher than the 1989 State average. The same is true of dropout rate. Although there Is a 2 6% 
difference in the 1989 dropout rate of District C and District F, considering they have high 
school enrollments of approximately 200 and 350 respectively, these differences, practically 
speaking, are Insignificant. Dropout rates for all six districts are lower than the state's 
average. 

Differences among districts are more pronoun jed In relation to college attendance and 
overall postsecondary attendance. All districts except District E show increases In college 
attendance, wHh those of Districts A and B being the greatest; however, college attendance in 
these "improving districts" remains below that of the state as a whole. Only the college 
attendance rates of Districts C and D are above those of the state. No contextual variations could 
be Identified which might account for these differences in postsecondary attendance rates. In 
addition, no pattern of district level action or superintendent behavior was identified which 
might be linked to these student outcomes. 
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Conflicts Bftwaen TaRti ng and Non-Test OutCQmas 



The greatest conflict in relation to Identifying a district as Improving or nonlmprovlna 
on the basis of its State Minimum Competency Test (MOT) performance and non-lest Indicator 
data is in District D which clearly demonstrates Improvement and relatively high performance 
on the outcome of college and postseoondary attendance, but nonlmproving test results. A second 
conflict is apparent In Districts A and B which have improving MCT perfbnnance. but relatively 
low percentages of students pursuing college and other postseoondary educational experiences 
although both districts do show Improvement in this indicator of student outcomes. These 
comparisons illustrate the complexity of classifying a district as improving or nonlmproving on 
the basis of multiple indicators. The data also clearty iliustrate, however, the Inaccuracies of 
summarily classifying these districts as Improving or nonlmproving, effective or ineffective 
on the basis of a single indicator. 

Summary 

By comparing the actions of superintendents of districts with Improving and 
nonlmproving test performance, the current study provided the opportunity to search for 
patterns of difference or similarity which might support or refute the emerging image of the 
instructlonally effective school district portrayed In the literature. The final sectfon of this 
report returns to the seven factors identified in extant literature as characteristic of improving 
and effective districts and reports findings of the current study In relation to each of these 
factors. 

1) Formal district goals with an emphasis on student learning 

In the current study two improving districts and one nonlmproving district had formally 
established district goals, in only one district was there evidence of an emphasis on student 
learning in the goal content. 

2) Extensive staff development programs with emphasis on principals' 
supervisory skills and teachers' instructional shills. 

All improving districts and one nonlmproving district had systems of staff development 
similar to those described in the literature. There was no apparent difference in the quality of 
staff development or the type of programs offered in the improving districts and the one 
nonlmproving district. All four programs were clearly superior to those in two of the 
nonlmproving districts. 

3) Formal and systematic staff evaluation systems with criteria tied to the 
accomplishment of district goals. 

There was no indication that any district had tied staff evaluation systems to district 
goals. Even in the district In which the monitoring of district goals appeared to be fairly well 
refined, principals indicated they were not evaluated on the basis of goal accomplishment. As 
reported prevtously, there was evidence of greater attentfon to teacher evaluation and 
supervision in the improving districts. 

4) Peplacemant of ineffective principals and teachers 

Ail superintendents spoke of dismissing ineffective teachers. There was no evidence to 
suggest this action was more common in improving districts. 
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5) Standardized district curriculum and superintendents' personal Involvement 
In curriculum and Instruction. 

All districts had a standardized, written district curriculum; liowevor, principals In 
tHjth Improving and nonlmproving districts expressed skepticism concerning teacher use of the 
curriculum guides. Only one superintendent (Superintendent C) appeared to be highly involved 
in cunlculum and instruction. The superintendent who might be classified as "coming In 
second" in this regard was the superintendent of a nonlmproving district. 

6) Formal systems for monitoring progress on district goals snd student 
outcomes 

As reported previously, there was some evidence of greater attention to test results In 
Improving districts, but there was little other evidence of monitoring of student outcomes in 
either improving or nonlmproving districts. Although three districts (two Improving, one 
nonlmproving) had formally established district goals, only one district appeared to have a 
formalized system In place fOr monitoring goal accomplishment. 

7) Superintendent acquisition of funds for educational Improvement and 
centralized budget control. 

In five of the six districts (three Improving, two nonlmproving) superintendents were 
clearly in control of the budget. One nonlmproving district had a building-based budgeting 
system. In each of the centrally controlled districts principals spoke of the superintendent's 
skill In acquiring and managing funds for technical core Improvements. No pattern of difference 
was apparent In improving and nonlmproving districts In relation to the acquisition of funds or 
the superintendent's direct control of the budget. 

Final Commftnts 

In the current climate of accountability for results, educators and policymakers are 
anxious for prescriptions for action. Classroom, teacher, school and principal effectiveness 
correlates have been wkteiy accepted as the model for school Improvement. There is now a oreat 
desire to delineate the role of the district and superintendent. Careful examinatfon of classroom 
and school effectiveness research, however, reveals far greater complexity than the lists of 
effectiveness con-elates imply. As research on district level effectiveness progresses It is 
important to retain an appreciation for the effects and influences of the complexity at the 
district level. The current study and comparisons of the findings of this study with extant 
literature suggest the need for caution In adopting any single set of correlates at the district 
level as a prescription for improvement. 

Research associated with district level effects should certainly continue to search for 
patterns of behavior associated with district Improvement and effectiveness, but perhaps with 
the goal of Wentifying multiple paths rather than a single, five or six component, model. 
Ultimately, the most useful contribution of research may be the identification of relevant 
factors to be considered by practitioners In mapping their own paths to Improvement based on 
the unkiue contextual characteristics of their districts and the outcomes deemed most important 
for their students. 
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